Convergence of The Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions under Near-Monotone Costs

نویسندگان

  • Ari Arapostathis
  • Vivek S. Borkar
  • K. Suresh Kumar
چکیده

We study the relative value iteration for the ergodic control problem under a nearmonotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasilinear parabolic Cauchy initial value problem in R. We show that this Cauchy problem stabilizes, or in other words, that the solution of the quasilinear parabolic equation converges for every bounded initial condition in C(R) to the solution of the Hamilton– Jacobi–Bellman (HJB) equation associated with the ergodic control problem.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Correction to "A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions"

In A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions, [SIAM J. Control Optim., 50 (2012), pp. 1886–1902], convergence of the relative value iteration for the ergodic control problem for a nondegenerate diffusion controlled through its drift was established, under the assumption of geometric ergodicity, using two methods: (a) the theory of monotone dynamical systems an...

متن کامل

A Correction to “A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions'' | SIAM Journal on Control and Optimization | Vol. 55, No. 3 | Society for Industrial and Applied Mathematics

In A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions, [SIAM J. Control Optim., 50 (2012), pp. 1886–1902], convergence of the relative value iteration for the ergodic control problem for a nondegenerate diffusion controlled through its drift was established, under the assumption of geometric ergodicity, using two methods: (a) the theory of monotone dynamical systems an...

متن کامل

Convergence of the Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions

We study the relative value iteration for the ergodic control problem under a nearmonotone running cost structure for a nondegenerate diffusion controlled through its drift. This algorithm takes the form of a quasi-linear parabolic Cauchy initial value problem in Rd. We show that this Cauchy problem stabilizes or, in other words, that the solution of the quasi-linear parabolic equation converge...

متن کامل

A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions

Abstract. The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton–Jacobi– Bellman (HJB) equation. A nonlinear parabolic evolution equation is then proposed as a continuous time continuous state space analog of White’s ‘relative value iteration’ ...

متن کامل

On the policy iteration algorithm for non-degenerate controlled diffusions under the ergodic criterion

The subject of this paper is the policy iteration algorithm for non-degenerate controlled diffusions. The results parallel the ones in Meyn [11] for discrete-time controlled Markov chains. The model in [11] uses normlike running costs, while we opt for the milder assumption of near-monotone costs. Also, instead of employing a blanket Lyapunov stability hypothesis, we provide a characterization ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • SIAM J. Control and Optimization

دوره 52  شماره 

صفحات  -

تاریخ انتشار 2014